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INSTITUTIONAL EFFECTIVENESS: A GUIDE TO IMPLEMENTATION 



Accreditation ’s fundamental 
purposes 

^ assure quality of an 
institution, and 
^ facilitate continuous 
improvement 



Institutional effectiveness is "the process of 
articulating the mission, setting goals, and using 
data to form assessments in on ongoing cycle of 
goal setting and planning" (Grossman & Duncan, 
1 989). This definition encapsulates the intent of 
the ACICS criteria and expectations for the 
Institutional Effectiveness Plan (lEP) of accredited 
institutions. 



ACICS was an early adopter 
of the institutional 
effectiveness movement. 



The institutional mission 
drives the institutional 
effectiveness plan. 



The Accrediting Council for Independent 
Colleges and Schaals (ACICS) published criteria 
an institutional effectiveness in 1 991 . The criteria 
facus an educational autcames and 
impravement af thase outcames. The outcames 
include retention, placement, student learning, 
graduate satisfactian and emplayer satisfactian. 
Institutions are reguired ta dacument continuaus 
impravement thraugh a written Institutianal 
Effectiveness Plan. This monagraph pravides a 
brief backgraund af ACICS's appraach ta 
institutional effectiveness, the purpose of the lER a 
discussion of ACICS Accreditation Criteria 
Sections 3-1-111 through 3-1-113, 
characteristics of the lER a "how to" section, a 
sample lER key terms, and references. 



The best practices section is an exciting new 
addition to this revision. The section includes 
guidance and examples for developing the lEP; 
establishing benchmarks; selecting and 
interpreting data; implementing the lEP; 
documenting progress; and reviewing, assessing, 
and evaluating the lER 



ACICS's Approach to Institutional Effectiveness 



Accreditation's fundamental purposes are to (1) 
assure the duality of an institution, and (2) facilitate 
the continuous improvement within an institution. 
This is reflected in the mission of the Accrediting 
Council for Independent Colleges and Schools 
(ACICS), which is ta advance educationai 
exceiience for students at independent, nan- 
pubiic career schaais, caiieges, and 
arganizatians, in the United States and abraad. 
This is achieved through a deiiberate and 
tharaugh accreditatian process af guaiity 
assessment and enhancement as weii as ethicai 
business practices and educatianai practices. 



Accrediting agencies recognized that institutional 
effectiveness was a method for achieving both 
duality control and continuaus impravement. Until 
the mid-1980s, accrediting agencies had 
facused predaminately on input measures, such 
as enrallments and numbers of books in the 
library, with little attention given to output 
measures such as placement and graduation 



rates. ACICS was an early adopter of the 
institutional effectiveness movement seeing its 
usefulness in achieving the mission of ACICS 
accreditation: compiiance with ACICS standards 
and the process of continuous improvement. 

In the late 1 980s, the Council on Postsecondary 
Accreditation (now Council for Higher Education 
Accreditation) made the following statements 
about institutional effectiveness: 

The duality af an educational pracess 
is related ta (1 ) The appropriateness af 
its adjectives; (2) the effectiveness of 
the use of resources in pursuing these 
objectives; and (3) the degree ta 
which these objectives are achieved. 
Without a clear statement af what the 
educatian is expected to provide, it is 
not possible to determine how good it 
is. 



During the 1990s, accrediting agencies firmly 
established institutional effectiveness as the object 
for evaluation. ACICS published the first formal 
institutional effectiveness criteria in 1 991 . Gver the 
years, the criteria have been revised as aur 
understanding af institutianal effectiveness and the 
needs of institutions change. However, the core of 
the institutional effectiveness criteria remains that 
of "evaluating the succes of each institution in 
meeting its published mission" (1991). The 
institutionai mission drives the institutionai 
effectiveness pian. All of the institutional 
effectiveness indicators selected by an institution 
should link to the mission to demonstrate mission 
achievement and continuous improvement. 
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Purposes of the lEP 

The lEP serves as many purposes as there are 
institutions, but the most important purpose, and 
the purpose common to oii institutions, is 
continuous improvement throughout the 
institution. ACiCS iooks for continuous 
improvement demonstrated specificaiiy in 
educotionai programs and processes. A weii- 
conceived and impiemented iEP con serve other 
purposes as weii. These purposes are to achieve 
internai effectiveness, assess progress and the 
need for change, communicate autcames to 
the pubiic, and demonstrate reguiotory 
compiionce. 

Continuous improvement 

The most important purpose of the iEP is to 
continuousiy improve the institution, by providing 
a tooi for pianning, a method of documenting 
outcomes, and a system for recording the 
summary and onoiysis of data during the process 
of deveioping short- and iong-term goois 
designed to improve the institution. 

internai Effectiveness 

The process of deveioping the iEP can assist the 
institution in achieving internai effectiveness 
through its use in estobiishing goais for both short- 
ond iong-term success. Further, criteria for 
measuring the accompiishment of these goois 
con be defined, aiiowing the institution to focus its 
pians and activities on the criticoi activities 
needed for effectiveness. Once defined, these 
goois and criteria con be used to unify 
administrative and educotionai activities to 
achieve a high degree of commitment and 
common direction among aii empioyees. 

Assess Progress and Change 

Another internai benefit con be obtained when 
the iEP is used to assess progress and the need for 
change. Estobiishing and impiementing a 
continuous review process con heip the institution 
increase effectiveness by making timeiy changes 
based upon voiid information. The institution can 
respond prooctiveiy rather than reoctiveiy to 
opportunities or threats. 

Communicate Outcomes 



overoii guaiity. Constituents may be externai such 
as graduates, empioyers, and community 
ieoders, or internai, facuity, students, and staff. 
Having information which depicts the most 
important eiements of the institution's operation 
communicates cieoriy and accurateiy how weii 
the institution is meeting the needs of constituents 
and providing guaiity ieorning experiences. 

institutionai effectiveness provides o direct 
response to the guestion, "What voiue do we 
receive for the money invested?" A weii- 
conceived and appropriateiy impiemented 
institutionai effectiveness pion provides 
information which institutionai stakehoiders use to 
enhance the guaiity of educotionai processes 
within the institution. The data derived from the iEP 
aiso eguips institutionai stakehoiders to 
confidentiy respond to guestions such as, " What 
have your students reoiiy iearned?" "How do you 
know ieorning has occurred?" "What happens to 
your graduates?" "Are your graduates 
successfuiiy empioyed?" "What vaiue has your 
institution added to the community?" 

Demonstrate Reouiatorv Compiionce 

The iEP con meet the expectations and 
reguirements of approving agencies and 
accrediting associations, inciuding state boards 
and ACiCS. A document which defines 
institutionai goois and educotionai processes is o 
primary focus of most accrediting agencies as 
they measure overaii effectiveness and the 
guaiity of programs and services provided. 



in addition, the iEP can be instrumentai in 
communicating key information to constituents 
regarding the institution's goois, its degree of 
effectiveness, and how it pians to enhance 



Purposes of the IEP: 

Continuous 
improvement 
Achieve internal 
effectiveness 
Assess progress and 
change 

Communicate outcomes 
Demonstrate regulatory 
compliance 
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ACICS Accreditation Criteria 



The primary purpose of IE is 
to demonstrate continuous 
improvement. 



From the definition, " the process of articuiating the 
mission, setting goais, and using data to form 
assessments in an ongoing cycie of goai setting 
and pianning," we see that institutionoi 
effectiveness is a process, The process is cyciicai 
and inciudes pianning, goai setting, 
impiementation, and evaiuation. Each of these 
components is recognized in the ACiCS standards. 
Sections 3-1-110 and 3-1-111 address mission 
arficuiafion, pianning and goai setting, and 
Sections 3-1-112 and 3-1-113 address 
impiementation and evaiuation respectiveiy. 
Sections 3-1-110 through 3-1-113 of the 
Aaareditation Criteria foiiow: 



Councii Expectations forCompiionce 



unique to the institution; therefore, no two pians 
are aiike. There are as many different iEPs as 
there are missions, but the iEPs wiii have 
common eiements as seen in Sections 3-1 -1 1 1 
through 3-1 -11 3, 

3-1 -1 1 1 iNSTiTUTiONAL EFFECTiVENESS PLAN 



Eaah institution shaii have on fiie an institutionoi 
Effeativeness Pian fiEP] that desaribes the 
aharaateristias of the programs offered and of 
the student popuiation, desaribes what types of 
data wiii be used for assessment identifies 
outaomes, and states how aontinuous 
improvement wiii be made to improve or 
enhanae outaomes. At a minimum, the 
foiiowing five eiements wiii be evaiuated for 
institutionoi effeativeness: 



The foiiowino seotion is provided for oiaritv. 
Eoiiowina the institutionoi Effeativeness oriteria is a 
disoussion of the intent of the oriterio whioh is 
presented in narrative format, non-itoiios. The intent 
represents Counoii expeotations for oompiianoe. 
The itoiicized text is token directiy from the ACiCS 
Criteria. The non-itoiicized text is the discussion. 

3-1-110 iNSTiTUTiONAL EFFECTiVENESS 

An important indioafion of the overaii effeativeness 
of an ACiCS-aooredited institution is the degree to 
whioh it meets its own predetermined eduoationai 
outaomes. Eaoh ACiCS-aooredited institution, 
oonsistent with its mission, shaii deveiop and 
impiement an insfitutionai Effeativeness Pian that 
identifies how it pians to assess and oontinuousiv 
improve its eduoationai programs and processes, 
and that addresses its abiiitv to meet the 
eduoationai and oooupationai obieotives of its 
programs, in this dooument, eaoh institution 
shouid attempt to inoorporate short-term 
obieotives to be aooompiished in order to aohieve 
the mission of the institution and its future goais. 

Section 3-1-110 is the most straightforward and 
obvious of aii the iEP criteria. Very simpiy, the 
institution shouid have a written pian, or the iEP; and 
the iEP must be oongruent with the insfitutionai 
mission. Very iittie judgment is required for 
determining compiiance for this section. Either the 
institution has a written pian or it does not; the pian is 
congruent with the mission or it is not. Few citations 
are found for section 3-1-110. Most institutions 
deveiop a written pian that is congruent with the 
mission. Thus, the institution has successfuiiy begun 
the iEP process. 



fa] student retention rates: 

fb) student piaoement rates; 

To] /eve/ of graduate satisfaotion; 

fd) /eve/ of empiover safisfaotion; and 

fe) student iearnina outaomes. 

in oompiiina the data needed to assess the /eve/ 
of graduate satisfaotion and the /eve/ of 
empiover satisfaotion, eaoh institution shaii 
identify and desoribe how the data were 
ooiieoted, the rationaie for using eaoh type of 
data, a summary and anaivsis of the data 
ooiieoted, and how the data have been used to 
improve eduoationai orooesses. 

The data needed to demonstrate student 
iearnina outaomes inoiudes baseiine data and 
data to support that student iearnina has 
ooourred. Exampies of data may inoiude, but 
are not iimited to, oourse grades, GPA, CGPA, 
ore- and post-tests, entranoe assessments, 
portfoiios, standardized tests, professionai 
iioensure exams, and other measures ofskiii and 
oompetenov attainment Piaoement data 
shouid not be used exoiusiveiv to vaiidate 
student iearnina outoomes. 

Eaoh institution shaii pubiish annuai piaoement 
and retention goais. in formuiatina these goais, 
eaoh institution shaii take into aooount the 
retention and piaoement rates from the 
previous three Annuai insfitutionai Reports and 
the speoifio aotivities that wiii be undertaken to 
meet those goais. The aotivities demonstrate 
the institution's abiiitv to maintain or improve 
retention and piaoement outoomes eaoh year. 



4 



Just as missions are unique to institutions, the iEP is 





INSTITUTIONAL EFFECTIVENESS: A GUIDE TO IMPLEMENTATION 



Section 3-1-1 1 1 is the most detaiied of the iEP 
criteria and is the mast freduentiy cited section. To 
fociiitote understanding, short seiections ore 
extracted from this section and discussed. (Again, 
the itoiicized text is taken directiy from the Criteria. 
The non-itoiicized text is the discussion.) 

Each insfifufion shall have on file an Insfifufional 
Effectiveness Plan flEP] that describes the 
characferisfics of the proarams offered and of 
the student Dopulafion ... 

This component of the criteria is freguentiy cited, 
but, curiousiy, it shouid be one of the easiest 
pieces of information for on institution to provide. 
The iEP shouid inciude the programs the institution 
offers and the program characteristics. 
Characteristics couid inciude a variety of items, 
the most common being degree ievei, program 
description, objectives, rationaie for offering the 
program, and projections for future empioyment 
demands. Characteristics of the student 
popuiotion aiso couid inciude many items, the 
most common being student demographics: 
median age of student popuiotion, gender ratio, 
socioeconomic descriptors, maritoi status, and 
roce/ethnicity. These items shouid be inciuded for 
each program offered if the program 
demographics differ from the overaii institutionai 
demographics. 

Section 3-1 -111, continued 

, . . describes what types of data will be used for 
assessment identifies outcomes, and states how 
continuous improvement will be mode to 
improve or enhance outcomes. At o minimum, 
the followino five elements will be evaluafed for 
insfifufional effectiveness: 

to) student retention rotes; 
tbl student plocemenf rates; 
to] level of oraduafe safisfocfion: 
fdi level of employer satisfaction: and 
fei student learning outcomes. 

Section 3-1-111 identifies five eiements the 
institution must consider as it assesses and 
continuousiy improves its educationai programs 
and processes: student retention rates, student 
piacement rates, ievei of graduate satisfaction, 
ievei of empioyer satisfaction, and student 
iearning outcomes. These five eiements meet 
the minimum expectations of the Councii; 
however, institutions may inciude additionai 
eiements. 



effectiveness, in essence. Section 3-1-111 
reguires the institution to answer these three 
guestions. Where has the institution been? Where 
is the institution now? Where does the institution 
want to go? 

Where has the institution been? To answer this 
guestion, the iEP shouid inciude baseiine data for 
each of the five outcomes. The baseiine data 
provide o starting point for the institution, 
something to which the institution refers, to gouge 
and demonstrate improvement. Section 3-1-111 
specifies the baseiine data to be used for retention 
and piacement, the retention and piacement 
rotes from the previous three Annuoi institutionai 
Reports. 

Exampies of baseiine data for graduate and 
empioyer satisfaction might come from surveys. 
Baseiine data for student iearning outcomes might 
be program specific and might come from pre- 
ond post-tests. Many sources of baseiine data for 
these three eiements might be seiected. The 
sources of the baseiine data and rationaie for 
seiecting the data shouid be identified in the iEP 

Where is the institution now? To respond to this 
guestion, the iEP shouid inciude the characteristics 
of the programs offered and the student 
popuiotion. Additionaiiy, current data shouid be 
avaiiabie for each eiement which demonstrates 
how the institution wiii measure change from the 
baseiine data of each eiement. The comparison 
data wiii be used by the institution to identify 
changes made and changes needed. 

Where does the institution wont to go? The iEP 
shouid inciude goais for continuous improvement 
or enhancement of the five eiements. Specificaiiy, 
the pian shouid inciude how the data wiii be used 
to improve or enhance educationai processes 
and/or programs, in summary, an institution wiii use 
the data to discern if the iEP has in fact been 
impiemented with a goal toward continuous 
improvement of educationai programs and/or 
processes. 

Section 3-1-111, continued 

In compilino the data needed to assess the level of 
oraduate sotisfoction and the level of employer 
sotisfaction, each institution shall identify and 
describe how the data were collected, the 
rotionole for using each type of data, o summary 
and analysis of the data collected, and how the 
data hove been used to improve educational 
processes. 



Five elements of the IEP: 

retention rates 
rF placement rates 
rF graduate satisfaction 
rF employer satisfaction 
student learning 
outcomes 
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The five eiements are the institutionai indicators of 
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Most often, institutions use questionnaires to 
determine graduate and empioyer sotisfootion. 
Eooh oomponent of this paragraph must be 
addressed in the iER paying speoiai attention to 
providing a summary and anaiysis of the data 
and desoribing how the data have been used to 
improve eduoationai prooesses. institutions are 
frequentiy oited for not providing (1 ) a summary 
and anaiysis of the data, and/or (2) a desoription 
of how the data were used to demonstrate 
oontinuous improvement. Remember, the 
primary purpose of institutionai effeotiveness is to 
demonstrate oontinuous improvement . 



Student learning should he 
assessed continuously. 

The effectiveness of the 
assessment process is 
demonstrated in learning 
outcomes. 



Empioyer and graduate sotisfootion 
questionnaire data offers a rioh souroe of 
information on program heoith and viobiiity. Be 
speoifio in desoribing how the data were used to 
improve eduoationai prooesses. For exompie, if 
severoi survey responses indioote that a 
portiouior oompetenoy is no ionger required in 
the fieid, the institution shouid oonsider that 
information os a basis for revising or eiiminoting 
that oompetenoy from the ourriouium. There ore 
many, many other exompies of ways the 
questionnaire data ore used to improve 
eduoationai prooesses. 



Section 3-1 -1 1 1 , continued 



The data needed to demonstrate student 
iearning outcomes inciudes baseiine data and 
data ta suppart that student iearning has 
accurred. Exampies at data may inciude, but 
are nat iimited ta, caurse grades, GPA, CGPA, 
are- and past-tests, entrance assessments, 
partfaiias, standardized tests, prafessianai 
iicensure exams, and ather measures afskiii and 
campetencv attainment Piacement data 
shauid nat be used exciusivelv ta vaiidate 
student learning autcames. 



6 



"Student iearning outoomes" is the ieost 
understood eiement of effeotiveness. ACiCS 
requires that institutions show evidenoe of 
sfudent iearning. Learning is defined os a 
"ohonge in behavior." To demonstrate that 
student iearning has ooourred requires both 
assessment os a oontinuous prooess and the 
demonstration of outoomes. Foouity, os 
eduootion experts, determine what the resuits 
shouid be and how iearning shouid be assessed 
to assure the desired outoomes. Foouity ore 
ohoiienged to agree on how iearning shouid be 
assessed oiong the way. 

Assessment: Foouity assess student iearning 



throughout a student's progression in eooh 
oourse of study and for the overoii program. The 
objeotive of assessment is to measure the 
differenoes or ohonges mode in students' iives os 
a resuit of their experienoes at the institution. 



The information gieoned from assessment is then 
used to improve the quoiity of the eduoationai 
prooess, ourriouium, and instruotion, whioh wiii 
maximize the oopooity for iearning. Assessment 
shouid inoiude a variety of methods appropriate 
to oduit ieorners and the methods shouid 
aooommodote various iearning styies. As on 
exompie, a student iearning assessment prooess 
might inoiude some or oii of the foiiowing: pre- 
ond post-tests, journois or portfoiios, oommunity 
servioe, standardized finoi exams, oopstone 
oourses, o e r t i f i o a t i o n exams, 
internship/externship experienoes. Strengths and 
weaknesses of the teoohing and iearning 
prooess wiii emerge os prootioes and produots 
ore assessed. 

Student iearning assessment shouid oiso inoiude 
evaiuotion of job-reioted oompetenoies that 
address both aoodemio and personoi skiiis suoh 
os work attitude, motivation, oritiooi thinking, and 
oommuniootion skiiis. in a weii-pionned 
program, these skiiis oon and shouid be 
measured throughout the student's enroiiment. 
Whiie standardized assessments may be used 
for this purpose, the invoivement of foouity is 
oritiooi in deveioping the instruments and 
prooesses required to measure job-reioted 
oompetenoies. Sinoe institutions, programs, 
and student popuiotions vary, foouity shouid 
oiwoys be invoived in the deveiopment of 
student iearning outoomes assessment, Quoiity 
improvement is a prooess that depends on 
oontinuoi assessment and tweaking oiong the 
way. 

Outoomes: The effeotiveness of the assessment 
prooess is demonstrated in the outoomes. 
Troditionoiiy, student iearning outoomes ore 
evoiuoted by reviewing grades and tronsoripts. 
Reviewing tronsoripts and grades ore, orguabiy, 
indiootors that iearning has ooourred, but, given 
the inherent subjeotivity in grading, these shouid 
not be the oniy indiootors. Competenoy-bosed 
eduootion has beoome on aooeptobie way to 
deoi with outoomes assessment. Speoifio 
performonoe standards ore often estobiished for 
a portiouior oourse or program with the student 
required to meet those standards. 
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For example, the American Association of Medical 
Assistants (AAMA) Standards and Guidelines 
identify national standards of competency for 
medical assistants. Many other professional 
associations also have established national 
competency standards for specific fields. 
National standards are appropriate outcomes to 
strive for. 

An effective plan for measuring student learning 
outcomes should describe both the assessment 
model and the expected outcomes for each 
program in terms of the knowledge gained, skills 
acquired, and attitudes and behaviors influenced. 
The plan should include evidence that students' 
lives are changing (assessment) and have 
changed (outcomes). The quality of the 
educational process is assured and enhanced 
through this process. 

Section 3-1 -1 11 , continued 

Each Institution shall publish annual placement 
and retention goals. In formulating these goals, 
each Institutlan shall take Inta accaunt the 
retentlan and placement rates tram the prevlaus 
three Annual Institutlanal Reoarts and the specific 
activities that will be undertaken to meet those 
goals. The activities demonstrate the Institution's 
ability to maintain or Improve retention and 
placement autcames each year 

Each institution has the retention and placement 
data from the Annual Institutional Report (AIR). The 
data for the past three years should be reported in 
the lER Goals for retention and placement are 
based upon the AIR data. Perhaps your institution 
has retention and placement percentages that 
you are satisfied with; but there are always ways to 
improve, the percentages and the processes. 

3-1 -1 1 2 IMPLEMENTATIGN AND MGNITGRING GF 
THE INSTITUTIGNAL EFFEGTIVENESS PLAN 

Institutlans shall dacument that the specific 
activities listed In the plan are carried out and that 
perladic progress reoarts are campleted ta 
ensure that the plan's activities are Implemented. 
Appropriate Individuals should be assigned 
responsibility for Implementing and monitoring 
the Institutional Effectiveness Plan. 



the lEP An institutional effectiveness team may 
be comprised of the president of the institution, a 
senior administrator (usually the dean of 
academics), a representative from admissions 
and placement, faculty program coordinators or 
department chairs, and a student leader. The 
designated person or team should be key 
decision-makers, or have access to the key 
decision-makers. The size and composition of 
the team is up to the institution. 

It is important that the institution does have a 
designated person or group responsible for 
implementing and monitoring the lER And that 
the person or group knows who they are and 
what their responsibilities arel A good way to 
document progress is through the minutes of the 
team and/or through minutes of staff and faculty 
meetings. Many institutions find that a quarterly 
review of the lEP works well, documented, of 
course. Minor revisions to goals may occur 
during the monitoring period. The lEP should not 
be substantively revised until the annual 
evaluation, unless there is a major change in 
institutional mission and/or leadership. 

3-1-113 EVALUATIGN GF THE INSTITUTIGNAL 
EFFEGTIVENESS PLAN 

Institutions shall evaluate the plan. Its goals, and 
activities at least annually. Evaluation requires 
the determination of Initial baseline rates and a 
measurement of results after planned activities 
have occurred. Institutions shall maintain 
documentation of historical outcomes and 
show evidence of how this documentation Is 
used to achieve expected goals. Institutions 
should adjust their goals accordingly as a result 
of an evaluation of the Institutional Effectiveness 
Plan. 

The annual evaluation represents a summation 
of the monitoring activity and/or quarterly 
reviews. The findings should be documented. 
The evaluation is used to develop or revise the 
goals. 



The lEP should be 
assessed quarterly and 
evaluated annually. 



The lEP should include the name(s) of those 
responsible for implementing and monitoring the 
lER Although a committee or team is not 
prescribed, many institutions find that a team 
tasked with implementing and monitoring the lEP is 
the most effective and efficient way to manage 
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SUMMARY 



Planning Tools: 

environmental scan 
SWOT 
mission 
vision 



"Quality is never an accident; it is always the result 
at high intentian, sincere effcrt, intelligent 
directicn and skillful executian; it represents the 
wise chaice at many alternatives." The lEP is a 
living dacument that "represents the wise chaice 
cf many alternatives." (WillaA. Faster) 

Institutional effectiveness measures both 
institutional quality and aaademia quality. 
Institutional quality is determined by 
appropriateness of mission and goals, effective 
use of resources to achieve goals, and the 
degree to which goals ore achieved. Aaademia 
quality is determined through student learning 
assessment and outcomes, retention, 
placement, graduate satisfaction, and employer 
satisfaction. 



The lEP is typically developed for a period of three 
to five years. Like any big, important task, taking 
the first step is usually the most challenging. 
Attention to the characteristics of developing the 
lEP will assure that the process becomes exciting, 
engaging, and enlightening. 

Characteristics of a good lEP consist of a 
thorough planning process which involves key 
stakeholders who look at the external and internal 
environment of the institution; analyze the labor 
market trends and projections; identify the 
institution's strengths and weaknesses; ask the 
hard questions, "Are we doing the right things, and 
are we doing those things right?"; examine 
alternatives; identify opportunities and threats; 
articulate the most distinctive future for the 
institution; identify strategies and develop 
measurable goals; implement the lEP; assess the 
lEP at regular, periodic intervals, usually quarterly, 
and revise os needed; communicate the 
progress to the constituents. 

The process is iterative and cyclical. The lEP is 
never really "finished." It is o road map to the 
institution's destination, and the destination 
represents the institution's bestfuturel 
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Best Practices 

In preparing this section of the monograph, severoi institutionai effectiveness pions were reviewed. Eight 
pions were seiected from iEPs that team members and Commissioners on 2003 accreditation visits 
identified as exempiary. iEPs were seiected from oii credentiai ieveis: one nondegree, three occupotionoi 
associate's degree, two academic associate's degree, one bacheior's degree, and one master's degree. 
The sizes of the institutions varied from smoii, famiiy-owned institutions to those owned corporoteiy The iEP 
contributors grociousiy hove permitted us to use their iEPs, in port or whoie, os exampies of best practices. 
The contributors hove asked to remain anonymous. Reviewing the pians, the characteristics described 
beiow emerged as best practices. 

Pieose remember as you read these best practices, that, uniess otherwise stated, not oii iEPs contained 
everything iisted. For exampie, the institutionai Effectiveness (iE) teams deveioped at the eight institutions 
varied in size from three members to o dozen. Aiso, data sources used varied from two sources per 
category to severoi. How the iEP is constructed depends on institutionai cuiture, resources, goois, and styie. 

i. The Team, or Who's Responsibie? 

Aii iEPs were deveioped, impiemented, and monitored by a weii-identified team of institutionai ieaders and 
key decision-makers. Most iE teams were comprised of some combination of the foiiowing positions: 
director, academic dean, admissions coordinator, student services director, piacement coordinator, 
retention coordinator, financioi aid administrator, director of computer information systems, and program 
choir(s). The function of the team was to deveiop, impiement, and monitor the iEP The iE team met three to 
four times in the year to discuss progress, in interviews with the contributors, oii stressed the importance of 
invoiving representatives from across the institution. They oii emphasized that the success of the iEP couid be 
correiated to the ievei of engagement and interest in the process as demonstrated by the campus director. 
At aii eight institutions, the person uitimateiy occountabie for the pion was the campus director. 

ii. Data Resources 

Aii iEPs iisted data sources. Data from the Annuai institutionai Report (AiR) ore required for the iEP Other than 
that, the data seiected for the iEP is driven by goais for each eiement. Some institutions seiected oniy a 
coupie of data sources for each eiement, others used severoi. The foiiowing data sources were frequentiy 
cited os information sources for the five required eiements of the iEP: 



Student Learning Outcomes 
Oourse grades 
Oumuiative GPA 

Notionoi and state certification and iicensure outcomes 

Oopstone courses 

Portfoiios 

Notionoiiy-normed pre-tests and post-tests 
Oourse and/or program exams 
Oompetency (skiii) checkiists 
Standard Academic Progress 
Program review data 
Focuity performance review data 

Procticum (assessment of student performance as observed by site preceptor) 
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student Retention 



The Annual Institutional Report (AIR) (three years of data) 

IPEDS data 

Weekly monitoring of withdrawals 
Weekly monitoring of student attendance 
Retention trends by program (three years) 

Quarterly program enrollment 
Quarterly cohort retention monitoring 
Current student program satisfaction surveys 
Current student institutional satisfaction surveys 
Student course/foculty perception-of-guality surveys 
Noel Levitz (or other) national surveys 
Exit interview data 

New student orientation (student perception of effectiveness) 
Student services available (student perception of effectiveness) 
Student organizations (student perception of effectiveness) 

Student Placement 



The Annual Institutional Report (AIR) (three years of data) 

IPEDS data 

Quarterly placement reports 

Analysis of placement numbers (in field, out of field) 

Entry-level salary 

Placement process (student perception of effectiveness) 

Placement trends by program (three years) 

Analysis of length of time student stays employed 
Program review data 

Graduate Satisfaction Survey 

Analysis of length of time student stays employed 
Program review data 

Level of preparation to enter the field (graduate perception of strengths and weaknesses of the training 
received) 

Placement process (graduate perception of effectiveness) 

Employer Satisfaction Survey 

Analysis of length of time student stays employed 
Program review data 

Employer surveys regarding perceived level of preparation to enter the field (strengths and weaknesses 
of the training received) 

III. Developing the document 

The lEPs reviewed were structured and formatted to reflect the style and meet the needs of the institution. 
Each lEP was unique in appearance and content. However, most of the lEPs contained the following 
sections: 

□introduction 
□Mission and objectives 

□List of IE team members with indication of the person responsible 
□student demographics (institutional and program) 

□Program characteristics 
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□ The five elements: retention, student learning outcomes, placement, graduate satisfaction, 
employer satisfaction 

□ Benchmark data for each element (AIR and Key Operating Statistics) 

□ Goals for each element 

□ Activities required to accomplish the goals 

□ Timelines for accomplishing the goals 

□ Assessment and evaluation of the lEP 

□ Examples of continuous improvement 

IV. Implementation of the lEP 

The eight institutions employed various strategies to implement the lEP A common strategy was to assign the 
team members specific areas of responsibility and goals. The team member involved colleagues from 
respective departments in meeting the responsibility and working toward the assigned goal. Each team 
member would then report to the team at large during regularly scheduled meetings. This strategy serves 
two important purposes: (1 ) a broader audience is involved in the institutional effectiveness process, and (2) 
communication about the lEP and the institutional goals are more widely disseminated. 

Some institutions had an IE team with sub-teams responsible for each goal. This served the same two 
purposes listed above. Smaller institutions depended on the campus director or the academic dean to 
implement the plan. Even in this situation, the lEP leader actively involved constituents, had regular 
meetings, and communicated progress throughout the institution, 

V. Monitoring the lEP 

All institutions monitored the lEP by conducting regularly scheduled meetings, usually quarterly, in which the 
IE team discussed and documented the status of the lEP Monitoring was commonly documented through 
minutes of meetings. 

VI. Documenting progress 

The primary purpose of the lEP is to demonstrate continuous improvement of the institution with a special 
focus on educational programs and processes. Progress is determined through systematic and regularly 
scheduled reviews of the activities associated with the goals of the lER The eight institutions hod detailed 
methods to track progress. Progress must be noted and recorded. Many used charts. A progress chart is 
on appropriate visual cue for identifying completed activities and goals achieved. As challenges arise, they 
con be addressed early when regularly scheduled meetings ore held. 

VII. Evaluating the lEP 

The institutions charted and documented progress at each monitoring meeting. The annual review of the 
lEP will be the culmination of the progress reports. A summary report of the annual evaluation of the lEP 
should be available. The report would include goals accomplished and new or revised annual goals. 
Should a goal not be realized, the rationale for not accomplishing the goal should be included in the 
annual report. 



1 1 





SAMPLE 



Institutional Effectiveness Plan for 
Best College of Business and Technology (BCBT) 

Anywhere, USA 
2003 

The sample Institutional Effectiveness Plan (lEP) below was developed for o fictitious institution. Best College 
of Business and Technology in Anywhere, USA, The lEP includes the minimum components required to be in 
compliance with ACICS standards. The reader should keep in mind that the format, structure, style, and 
content of this sample lEP is not intended for duplication. The sample was developed from pieces of lEPs 
copied from the eight "best practices" lEPs. The lEP developed for your institution should reflect the 
uniqueness of the institution, In the case of lEPs, "one size" does not "fit all." 



Table of Contents 



Introduction 

The Institutional Effectiveness Team 
Mission, Goal, and Objectives 
Student Demographics 
Program Characteristics 
Retention and Placement 
Student Learning Outcomes 
Graduate and Employer Satisfaction 
2004 Goals 

Benchmark data 
Assessment activities 
Timelines and Responsibility 
Results 

Evaluation of the lEP 

Examples of Gontinuous Improvement 
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□ Introduction 

Just os relevant today is the 1977 quote by Robert Hutchins, a leader in strategic planning, "The only way you 
con criticize on institution, the only way you con appraise it, the only way you con determine whether it's 
good or bod or medium or indifferent is to know what it's about, what it's supposed to be , and what it's 
supposed to be doing. If you don't know these things, you haven't any standards of criticism." 
Before on institutional effectiveness plan con be written, on institution must know "what it's about, what it's 
supposed to be, and what it's supposed to be doing." 

Best College of Business and Technology (BCBT) was founded in 1976 to offer business programs at the 
occupational associate's degree level. In 1982, BCBT earned ACICS accreditation, and in 1997 was 
awarded accreditation to offer academic associate's degrees. BCBT is located in on urban area of 
Anytown, USA. 

In preparing for this plan. Best College of Business and Technology (BCBT) formed on Institutional 
Effectiveness (IE) team comprised of the director, academic dean, registrar, department chairs, admissions 
coordinator, and placement coordinator. The team examined issues of quality related to the following 
areas: institutional mission (role and scope), enrollment, relevance of current programs in the context of 
student learning outcomes and placement, and faculty and student engagement. From on analysis of the 
issues, the team identified institutional goals and objectives for educational processes and programs. The 
BCBT institutional effectiveness plan addresses the five elements os required by the Accrediting Council for 
Independent Colleges and Schools (ACICS): retention, student learning outcomes, placement, graduate 
satisfaction, and employer satisfaction. 

□ Mission, Goal, and Objectives 

The mission of Best College of Business and Technology is to serve students, employers, and their 
communities through education for careers in Business Administration and Computer Information Systems. 

The goal of BCBT is to be the college of choice for those wishing to pursue degrees, enhance job skills, or fill 
positions in: 

□ Business Administration: Accounting 

□ Business Administration: Marketing and Management 

□ Computer Information Systems: Microcomputer Applications 

□ Computer Information Systems: Networking, and 

□ Personal Computer Specialist 

The objectives of the college ore 

□ To serve the student 

□ By providing contemporary education in on independent, alternative educational system 
at a reasonable cost. 

□ By providing placement assistance for marketing the skills that hove been developed. 

□ By maintaining avenues for continuing academic and professional growth. 

□ To serve the employers 

□ By providing employers with high-quality personnel who hove a sound practical and 
technical, os well os theoretical, academic background and who ore aware of their 
responsibilities in their chosen career. 

□ To serve the community 

□ By providing on alternative education, free of tax support, with independence, innovation, 
responsiveness, and flexibility of operations. 
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□ student demographics 

BCBT enrolls 1 78 full-time students and 86 part-time students for a total of 264 students. 61 % of the student 
population is female, predominately single-parent. The median age of the student population is 26. BCBT 
has a diverse student population with 38% White, 31% Hispanic, 27% African American, and 4% Asian. 
Approximately 80% of the population is independent with an annual mean income of $22,000; 
approximately 20% of the population is dependent with a annual mean income of $4 1 ,000. 

BCBT offers two academic associate's degree programs, two occupational associate's degree programs, 
and one diploma program. 



Proqram 


Credential 


Percent enrollment 


Business Administration: Marketing and Management 


AAD 


19% 


Business Administration: Accounting 


AAD 


16% 


Computer Information Systems: Networking 


CAD 


32% 


Computer Information Systems: Microcomputer Applications 


CAD 


28% 


Personal Computer Specialist 


Diploma 


5% 



AAD = Academic Associate's Degree 
CAD = Occupational Associate's Degree 

□ Program Characteristics 

Business Administration: Marketing & Management (Academic Associate's Degree) 

BCBT offers this program to assist individuals in pursuit of marketing and/or management careers. 
The unique feature about this program is its cutting edge curriculum. Every program-related course 
includes instruction utilizing web technologies, advanced management principles, and strategic 
marketing practices. Courses in web site creation and electronic marketing ensure that graduates 
are able to promote their businesses on the World Wide Web in a manner that is effective and 
appealing. The program offers training in presentation graphics, desktop publishing, and database 
management, key productivity tools for any marketing professional. In order to become 
knowledgeable in the field of management, students take courses in supervision, human resource 
management, and small business management. Finally, general education courses, including 
public speaking and critical thinking, assist students to be successful in both their professional and 
personal lives. 

Business Administration: Marketing & Management core objectives 

□ Develop, implement, and monitor business plans 

□ Develop, implement, and monitor marketing plans 

□ Create and execute sales promotion programs 

□ Acquire the ability to implement human resource management principles and practices 

□ Create a presence on the World Wide Web in order to promote a business 

□ Develop skills to apply general accounting principles 

□ Use common business software productivity tools, including word processing software, 
databases, and spreadsheets 

□ Understand and apply laws and regulations related to owning and operating a small 
business 

□ Develop supervisory skills 
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Business Administration/Accounting (Academic Associate's Degree) 

This program is unique in that it offers a broad range of oontemporary aooounting and business 
praotioes. Students reeeive instruotion in the basio prineipies of aooounting and speoioity areas. As 
the fieid of aoaounting has beoome oomputerized, eaoh oourse inoiudes training in aooounting 
software suoh os QuiokBooks, TurboTox, and PeaohTree. in order to ensure that students understand 
generai business prineipies, business oourses are inoorporated into the ourrieuium. Aii students are 
offered the opportunity to reoeive training in the entire suite of Miorosoft Offioe, thus enobiing them 
to be fuiiy funotionoi in a brood range of jobs. To round out the eduoationoi experienoe and 
prepare students to be suooessfui on and off the job, generai oommuniootion and sooioi soienoe 
oourses ore integrated into the ourriouium. 

Business Adminisf ration! Accounting core objectives 

□ Deveiop skiiisto oppiy generai aooounting prinoipies 

□ Aoquire the obiiity to utiiize the prinoipies and prooedures of monogeriai aooounting 

□ Aoquire the obiiity to utiiize the prinoipies and prooedures of oost aooounting 

□ Aoquire the obiiity to utiiize the prinoipies and prooedures of poyroii aooounting 

□ Aoquire the obiiity to utiiize the prinoipies and prooedures of federoi inoome tax 
aooounting 

□ Aoquire the obiiity to utiiize the prinoipies and prooedures of nonprofit and governmentoi 
aooounting 

□ Aoquire the obiiity to utiiize the prineipies and prooedures of oomputerized aooounting 
software 

□ Gain on understanding of and oppiy basio business praotioes 

□ Use oommon business software produotivity toois, inoiuding word prooessing software, 
databases, and spreadsheets 

Computer Information Systems: Networking (Occupationai Associate's Degree) 

This program was designed to enobie graduates to seek ooreers in the fieid of network 
administration. Besides being awarded the Oooupotionai Assooiote's Degree, students ore offered 
aii of the ooursework neoessory to seek Miorosoft Certified Systems Engineer, A+, Certified Cisoo 
Network Administrator, and Miorosoft Offioe User Speoioiist oertifiootions. Students ore offered the 
opportunity to enhonoe their oommuniootion and sooioi skiiis by taking a series of generai 
eduootion oourses. 

Computer Information Systems! Networking core objectives 

□ Design, maintain, and impiement on enterprise-wide oomputer network 

□ Troubieshoot hardware probiems 

□ Setup and oonfigure internet routing 

□ Estobiish and maintain on enterprise-wide messaging and oommuniootions system 

□ Design and impiement databases using Miorosoft SQL Server 

□ Design, impiement, and administer a network infrostruoture 

□ Prepare for A-i- oertifiootion 

□ Prepare for Miorosoft Certified System Engineer oertifiootion 
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Computer Information Systems: Microcomputer Appiications (Occupationai Associate's 
Degree) 

This program was designed for individuois desiring both business and oomputer skiiis. Students take 
both introduotory and odvonoed oourses in oii of Miorosoft Offioe's produotivity oppiiootions; 
desktop pubiishing and bosio web site design ore inoiuded. From the business perspeotive, 
students ieorn aooounting prinoipies, oomputerized oooounting, smoii business management, 
and teohnioai report writing to ensure a weii-rounded baokground required for suooess in a 
business setting. The program prepares students to beoome Miorosoft Offioe User Speoiaiists. 

Computer Information Sysfems/Miorooomputer Applioations oore objeotives 

□ Use oommon business software produotivity toois, inoiuding word prooessing software, 
databases, desktap pubiishing saftware, and spreadsheets at an advanoed ievei 

□ Use internetteohnaiogy to oreate and maintain web pages 

□ Deveiap skiiis to appiygenerai aooounting prinoipies 

□ Buiid, repair, and troubieshaot hardware prabiems with persanai oomputers 

□ instaii, oonfigure, and upgrade saftware 

□ Gain an understanding at and appiy basio business praotioes 

□ Prepare for Miorosoft Offioe User Speoiaiist oertifioation 

Personal Computer Specialist (Dipioma) 

Students iearn the fundamentais of personai oomputer operation and papuiar business software in 
aii the major appiioations areas. These inoiude ward prooessing, desktop pubiishing, 
spreadsheets, databases, and presentation graphios. The program is designed to offer the 
student an opportunity to iearn types of oomputing that are of speoiai interest to him/her, suoh as 
website design, oomputer hardware, and oamputer pragramming. 

Persanai Computer Speoiaiist oore objeotives 

□ Deveiop a basio understanding at Miorasoft Windaws XP 

□ Deveiap the abiiity to use basio business software, inoiuding word prooessing, database, and 
spreadsheet appiioations 

□ Leverage the oapabiiities of the Miorosoft Offioe Suite to integrate appiioations 

□ Deveiop the abiiity to use the internet as a produotivity tooi 

□ Prepare for Miorosoft Offioe User Speoiaiist oertifioation 

□ Deveiop skiiis neoessary to oreate pawerfui resumes, aoquire job seeking skiiis, and 
demanstrate interviewing skiiis 

RETENTION AND PLACEMENT 

The retention trends for the programs as reparted in the past three ACiCS Annuai institutionai Reports 
are: 



RETENTION TREND DATA BY PROGRAM 



Praaram 


2000 


2001 


2002 


Business Administration: Aooounting 


76% 


68% 


70% 


Business Administration: Marketing and Management 


77% 


70% 


73% 


Oamputer infarmatian Systems: Mioraoomputer Appiioations 


75% 


75% 


72% 


Computer information Systems: Networking 


74% 


72% 


75% 


Personai Oamputer Speoiaiist 


74% 


69% 


69% 
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The placement trends for the programs as reported in the postthreeACICS Annual Institutional Reports ore: 

PLACEMENT TREND DATA BY PROGRAM 



Proaram 


2000 


2001 


2002 


Business Administration: Accounting 


82% 


83% 


85% 


Business Administration: Marketing and Management 


78% 


77% 


80% 


Computer Information Systems: Microcomputer Applications 


81% 


82% 


84% 


Computer Information Systems: Networking 


79% 


79% 


83% 


Personal Computer Specialist 


66% 


68% 


67% 



The retention trends for the institution as reported in the postthreeACICS Annual Institutional Reports are: 

RETENTION 

2000 2001 2002 

75% 71% 72% 



The placement trends for the institution os reported in the post three ACICS Annual Institutional Reports ore: 

PLACEMENT 

2000 2001 2002 

77% 78% 80% 

The key placement success indicators for BCBT ore placement in field and continuous employment in-field 
for three years. 

STUDENT LEARNING OUTCOMES 

BCBT uses multiple measures to asses student learning outcomes; for example, pre- and post-tests, 
cumulative GPA by program, review of grade distribution by subject and instructor, MOUS certifications 
earned by CIS program graduates and completers, o capstone course in the Business Administration 
programs, and o procticum experience in the CIS occupational associate's degree programs. Benchmarks 
ore established for each student learning outcome. 

GRADUATE SATISFACTION 

Graduates ore trained for entry-level positions in their fields through curricula that emphasize the actual skills 
needed in the field. The BGBT Graduate Satisfaction Survey (GSS) is Web-bosed and is sent to graduates 90 
days after graduation. The GSS includes institutional and program-specific items. Institutional items cover the 
graduate's perceived satisfaction with the services offered through the placement office. Program-specific 
items include the graduate's perceived level of preparation in specific skills reguired for the job. The survey is 
administered, tabulated, and analyzed by the registrar's office and reported to the IE team, faculty, and 
advisory committees. 



EMPLOYER SATISFACTION 

Employers of the institution's graduates receive a survey within 90 days of the graduate's employment. 
Employer responses to the items indicate the employer's opinion regarding the graduate's level of 
preparation in specific skills reguired for the job. The survey is administered, tabulated, and analyzed by the 
registrar's office and is reported to the IE team, faculty, and advisory committees. 
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Retention 

Data Collection, Timeline, Assessment Results 





Assessment Tool and Assessment 


Data 


Assessment Results 




Criteria 


Colleotion 

Timeline/ 

Responsibility 




1 ) To establish and 


Assessment Tool: 


Reviewed 


Results/Findings: 


meet annual retention 


AIR Retention Rate 


weekly, 




goals. 


Assessment Criteria: 


quarterly, and 






Historiool rotes ore used to 


annually 






determine goals for new year. 
Programs that fall below established 


Campus: 






baselines will be reguired to submit a 


Campus 






plan for improvement. 


Direotor 






Retention rates are set on a guarterly 


Management 






and annual basis (see retention 


Person: Vioe 






report). 


Registrar 




2) Provide opportunities 


Assessment Tool: 






to interoot with one 


Student Satisfaction Surveys 


Annually 


Results/Findings: 


another, potential 


Assessment Criteria: 






employers, and the 


Using the Student Satisfaotion Surveys 


Campus: 




oommunity. 


(orientation through graduation) 


Campus 






the following baselines have been 


Direotor 






established: 


Management 






Sooial Events 50% 


Person: 






Support From Faoulty 75% 


Admissions 






^ Spirited/Fun Environment 50% 
Orientation Sessions 75% 
Reoognition 65% 

Mission Statement 50% 
Reputation 80% 

Aoademio Programs 80% 

Email 60% 

Classroom Assignments 80% 
Enoouragement/Motivation 80% 
Aooessibility 80% 

The data is oolleoted and 
benohmarks are set and analyzed 
for improvement strategies when 
measures fall below established 
baselines. 


Direotor 
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Placement 

Data Collection, Timeline, Assessment Results 



Assessment Tool and Assessment Data Assessment Results 

Criteria Colleotlon 

Timeline/ 

Responsibility 



1 ) To aohleve and 
maintain plaoement 
rates above AC ICS 
average AIR rate. 



Assessment Tool: 

Placement Rates - AIR 
Assessment Criteria: 

Annually review the AIR overall 
plaoement rates. Establish goals for 
the upoomlng year. Campuses that 
fall below established baselines will 
be regulred to submit a plan for 
Improvement. 



Annually Results/Findings: 

Campus: 

Career 

Servloes 

Dlreotor 

Management 

Persan: 

Campus 

Dlreotor 



Assessment Tool: 

Alumni Surveys 
Assessment Criteria: 

Data 1s oolleoted with an alumni 
survey six months after student has 
graduated. Satistaotion peroentages 
reported on original surveys 
established a baseline. Analysis will 
look for an inorease in peroentage 
and indioate any needed 
improvement plans. 



Annually Results/Findings: 

Campus: 

Career 

Servloes 

Dlreotor 

Management 

Persan: 

Assooiate 

Campus 

Dlreotor 
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student Learning Outcomes 
Data Collection, Timeline, Assessment Results 



Assessment Tool and Assessment Data Assessment Results 

Criteria Colleotlon 

Timeline/ 

Responsibility 



1) Appropriately plaoe 
students to ensure 
oollege-level llteraoy 
and numeraoy. 



Assessment Tool: 

Persistence Study COMPASS 2000 
Cohort 

^ 1 999 Cohort 
^ 2000 Cohort 
^ 2001 Cohort 
Assessment Criteria: 

^ Using the foll/eorly toll oohort of 
beginning students who hove 
token all three oomposs exams 
and started in the foll/eorly toll 
of 1 999, the College will 
oontinue to trook the 
aoodemio performonoe and 
persistenoe to establish 
benohmork data. 

The seoond and third oohort group 
of students oonsists of those students 
who ore early fall/fall beginners 2000 
and 2001 . Stotistios on aoodemio 
performonoe and persistenoe will be 
gathered and oompored to the 
1 999 oohort group. 



Annually Results/Findings: 

Campus: 

Dean of 

Instruotionol 

Programs 

Management 

Persan: 

Campus 

Direotor 



2) Provide opportunities 
for positive interootion 
with fooulty and 
oourses whioh promote 
the skills neoessory for 
life-long learning and 
inquiry. 



Annually 

Campus: 

Dean of 

Instruotionol 

Programs 

Management 

Persan: 

Chief 

Aoodemio 

Offioer 



they ore with those areas. The 
ootegories ore: 

ELearning environment 
^Quality of instruotion 
^Teoohing tools 
Engagement 

Data oolleoted will be used os 
benohmork. 



Assessment Tool: 

End-af -Quarter Caurse Evaluatians 
Assessment Criteria: The goal for 
end-of-quorter evaluation is to 
provide feedbook on the overall 
quality of instruotion that students 
reoeive. The goal is to identify areas 
of oonoern and importonoe to 
students and then respond 
institutionally to these oonoerns. The 
format and questions ore based 
upon reseoroh done by Noel-Levitz. 
The format allows students to rote the 
importonoe of oertoin areas related 
to instruotion os well os how satisfied 



Results/Findings: 
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student Learning Outcomes 
Data Collection, Timeline, Assessment Results 



Assessment Tool and Assessment Data Assessment Results 

Criteria Colleotlon 

Timeline/ 

Responsibility 



3) To maintain a 
dynamlo buslness- 
eduoatlonal operation 
whloh provides on- 
going servloes and 
Initiates ohonge os 
needed to keep 
abreast of today's ever- 
ohonglng teohnology. 



Assessment Tool; 

Annual Program Review 
Assessment Criteria: 

A complete set of Program Review 
Binders (PRB) for each campus 
(consisting of one binder for each 
course for day and evening) will exist 
by the end of Fall 2001 and will be 
used to ensure that programs ore 
consistent In terms of course 
descriptions, performance 
objectives, content and Instruction 
with overall program objectives. The 
following Is to be Included In each 
PRB: Program objectives, 
assignments, and syllabus: 

^ Review program objectives to 
ensure they ore consistent with 
recommendations from 
Advisory Boards minutes. 

^ Review all program objectives to 
ensure they ore reflected In one 
or more of the following: 

- course descrlptlon(s), 

- performance objectlves(s) or 
assigned coursework. 

^ Review student enrollment, 
retention, and placement to 
demonstrate strength/accuracy 
of program objectives. Strength 
and accuracy to be defined In 
measurable terms for the 2001 - 
2002 criteria. 

By August 2001 (Professional 
Development Day) the departmental 
teams to complete the review of 
PRB's. End-of-progrom assessment 
tools will be Identified and added to 
departmental plans. Spring 2002 
annual program review assessing the 
above three bullets to be fully 
Implemented. 
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INSTITUTIONAL EFFECTIVENESS PLANNING: SAMPLE 



Graduate Satisfaction 

Data Coiiection, Timeiine, Assessment Resuits 



Assessment Tool and Assessment Data Assessment Results 

Criteria Colleotlon 

Timeline/ 

Responsibility 



1 ) To define traits and 


Assessment Tool; 




skills needed by 


Graduate Emplayer Survey 


Colleoted Results/Findings: 


graduates for 


Assessment Criteria: 


quarterly; 


suooessful entry-level 


Data is oolleoted on job 


Tallied 


employment and 


performanoe, desired entry-level 


annually in 


promotablllty. 


skills, general applioant weaknesses, 
employment trends, and software 


Ootober 




paokages used. Data to be 


Campus: 




analyzed for improvement will be on 


Career 




job performanoe ratings. Data 


Servioes 




oolleoted is to refloat improvement 


Direotor 




by 1 0% on previous history os 


Management 




indiooted below: 


Persan: 




Exoeeds Performanoe Rating 36% 


Campus 




Meets Job Expeototions 44% 

Meets Most Job Expeototions 0% 
Performanoe Below 
Expeototion 0% 

Also by inoreosing visits to employers 
the survey response should 
inoreose 25% 


Direotor 



Employer Satisfaction 

Data Collection, Timeline, Assessment Results 



Assessment Tool and Assessment Data Assessment Results 

Criteria Colleotlon 

Timeline/ 

Responsibility 



1 ) To define traits and 


Assessment Tool: 


Tallied 


skills needed by 


Data Base Emplayer Survey 


annually 


graduates for 


Assessment Criteria: 




suooessful entry-level 


To expand the database (beyond 


Campus: 


employment, sustained 


surveying just the graduates) to 


Career 


performanoe, and 


determine ourrent workplooe needs 


Servioes 


Promotablllty. 


and future job requirements. 


Direotor 

Management 

Persan: 

Campus 

Direotor 



Results/Findings: 



Evaluation of the lER 



see page 1 1 "Evaluating the lEP" 
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Examples of Continuous Improvement. 



see page 1 1 "Dooumenting Progress' 







INSTITUTIONAL EFFECTIVENESS PLANNING: KEY TERMS 



Key Terms 

Educational Outcomes 

Institutions may identify a variety of eduoational outoomes that result from a student's suoaessful oompletion 
of a program. The Counoil has identified the following os major outoomes and the ones that should, at a 
minimum, be addressed in the lEP: 

a) Retention peroentoge for the institution . 

(See formula, page 24] 

b) Plooement peroentoge for the institution , 

(See formula, page 24] 

o) Employer Satisfootion -determined by oonduoting periodio (at least annual) surveys of those 
who employed graduates over the post three years. 

d) Graduate Satisfootion -determined by oonduoting periodio (at least annual) surveys of 
graduates over the post three years. 

e) Student Learning Outoomes -determined by analyzing results of data gathered during the 
assessment of aoademio outoomes and job-related skill development. 

Institutions may also deoide to measure, summarize, and analyze data and information related to other 
types of outoomes, suoh os retention and plooement rotes for individual programs offered, default rotes, 
and many other items. 

Baseline Rates 

This data is analyzed for any of the eduoational outoomes for a speoifio period of time and is used os the 
foundation for making oomporisons ooross future time periods. For example, the institution may ohoose to 
use its retention and plooement rotes for a speoifio Annual Institutional Report (AIR) reporting year os its 
"baseline data." It will then oompore the data for future years to this "baseline data" to determine whether its 
eduoational outoomes ore improving, deolining, or remaining oonstont 

Historical Outcomes 

Historical data should be used for each element Historical outcomes for retention and placement rotes 
would be token from the previous three Annual Institutional Reports. A minimum of three years must be 
included in the lEP However, institutions may use data from prior years if it will help them obtain a clearer 
picture of their progress or set more realistic goals for future years. 

Continuous Improvement 

A process that involves on institution (1) systematically collecting data and information on each of the 
educational outcomes areas and achievement of its occupational objectives at least annually; (2) 
completing on analysis of the data and information including, but not limited to, a comparison with previous 
findings; and (3) identifying what changes in educational operations or activities it will moke based on the 
analysis. 

Level of Evaluation 

The level of evaluation is determined by the type of credential offered. An institution is categorized os being 
authorized to award non-degrees, occupational associate’s degrees, academic associate’s degrees, 
bacheior's degrees, or master's degrees. Institutions offering more than one type of credential ore 
classified and evaluated at the highest credential offered. 
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INSTITUTIONAL EFFECTIVENESS PLANNING: KEY TERMS 



Occupational Objectives 

These are a specific set of stated objectives for each educotionai program that identifies the 
competencies students wiii deveiop and the overaii career goais of the program. The objectives shouid be 
reosonabie for the program of instruction and the faciiities in which the program is offered and the mission 
of the institution. 

Retention and Placement Formulas 

(Use data from the Annual Insfifufional Report) 

Retention Percentage = (TE - W) / TE 

( Totoi Enroiiment - Withdrawoisl 
Totai Enroiiment* 

*Totoi Enroiiment = Beginning Enroiiment + New Starts + Reentries 



Piocement Percentage = (PF + PR) / (G - U) 

f Piaced in Fieid + Piaced in Reiated Fieid) 
(Graduates and Gompieters - Unavaiiabie for Piocement) 
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SUGGESTED REEERENCES: INSTITUTIONAL EEEECTIVENESS AND RELATED TOPICS 



Suggested References: Institutional Effectiveness and Related Topics 

Alfred, R., R Ewell, J. Hudgins, K. McClenney. Core Indicators of Effectiveness for Community Colleges. 
Washington D.C.: Community College Press. 1999. 

This monograph describes core Institutional effectiveness Indicators os Identified by key community 
college leaders and constituents. The Indicators ore similar to those Identified by career college 
leaders. 

Angelo, Thomas A., and Cross, K. Patricio. Classroom Assessment Techniques: A Handbook for College 
Teachers. Son Francisco: Jossey-Boss, 1 994. 

A classic In classroom assessment, and on excellent reference for 50 assessment techniques that 
con be used by faculty members to assess student learning outcomes. Addressed to college 
faculty regardless of their background or experience. For each classroom assessment technique 
(CAT) It Includes: levels of time and energy required, description, purpose, o list of teaching goals 
(related to o Teaching Goals Inventory presented earlier In the handbook), suggestions for use, 
examples from varied disciplines, step-by-step procedures, suggestions for analysis, benefits, 
cautions, and significant references. 

Astin, Alexander A. Assessment for Excellence: The Philosophy and Practice of Assessment and Evaluation In 
Higher Education. American Council on Education. New York: MacMillan Publishing Co., 1 991 . 

Astin's work continues to be relevant and compelling, despite the age of the book. Valuable 
assessment techniques ore described along with the suggested methods to analyze assessment 
data and present It to various audiences. Particularly Interesting Is Astin's further development of the 
concept of the l-E-O (Input-environment-output) assessment model and his notion of "talent 
development" os o framework for assessing quality. 

Bogue, E. Grady, and Saunders, Robert L. The Evidence for Quality: Strengthening the Tests of Academic and 
Administrative Effectiveness. Son Francisco: Jossey-Boss, 1 992. 

This book provides o comprehensive overview of Institutional effectiveness. It Includes chapters on 
defining academic quality assurance and quality enhancement and approaches to quality 
assurance, such os accreditation, college ranking and ratings, client satisfaction, professional 
licensure, academic program reviews, college outcomes, among others. 

Boothe, Barbara. The Institutional Effectiveness Manual: A Guide for the Development of an Cngoing, 
Comprehensive Institutional Effectiveness Planning Process. Transnational Association of Ghrlstlon Golleges 
and Schools, 2002, 

Dr. Boothe writes of Institutional effectiveness os o triad of strategic planning, assessment, and 
budget decisions. She provides many practical tools: committee structure, time lines, curriculum 
review plans, suggested data, and forms. 

Garr, Judy, and Harris, Douglas. Succeeding with Standards: Linking Curriculum, Assessment and Action 
Planning. Alexandria, Virginia: Association for Supervision and Gurriculum Development, 2001 . 

Although with an approach to standards and K- 1 2 levels, the authors present Ideas very appropriate 
to programs that deal with professional licensing. It Is focused on student learning and offers Ideas 
that can work when developing curriculum and assessment plans, faculty professional 
development plans, and reporting. It links the Institutional vision with an action plan In order to 
Improve student learning. 
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SUGGESTED REEERENCES: INSTITUTIONAL EEEECTIVENESS AND RELATED TOPICS 



Chaffee, Ellen E,, and Sherr, Lawrence A. Quality: Transforming Posfsecondary Education. ASHE-ERIC Higher 
Educatlan Repart Na. 3. Washingtan, DC: The Gearge Washingtan University, Graduate Schaal at Educatlan 
and Human Develapment, 1 992, 

Ghaffee and Sherr present a camprehensive picture cf duality In higher educatlan within the 
cantext at fatal duality management (TQM), The cantent at the managraph retains Its relevance In 
that the authars facus their discusslan an the duality Impravement thraugh evaluatlan at pracesses. 
The authars effectively describe llmitaticns asscclated with fccusing cniy cn cutccmes and nat 
Including Inputs and pracess In the discusslan at duality, 

DIamand, Rabert M, Designing and Assessing Courses and Curricula: A Practical Guide. San Francisca: 
Jassey-Bass, 1998, 

This managraph offers a practical approach to systemic change through curriculum design, goals, 
assessment, and to the design of programs with goals that consider multicultural diversity and 
critical thinking. An excellent book for faculty development activities. It Includes case histories from 
different scenarios, public and private, large or small Institutions, Very useful checklists ore provided 
os a gulck reference for answering questions and exploring alternatives that should be explored. It 
also Includes very good references to be considered as next readings, 

Erwin, T, Dory Assessing Student Learning and Development: A Guide to the Principles, Goals, and 
Methods of Determining College Cufcomes. San Francisco: Jossey-Boss, 1991, 

In simple and clear words, the author addresses Issues and strategies In developing on assessment 
program. It Includes a step-by-step guide for determining what Is to be assessed and how to 
determine program objectives. The author discusses how to ensure the quality and reliability of 
data, effective reporting, and use of assessment Information for positive change at an Institution, 

Green, John L,, and Jonas, Peter, Cufcomes assessment In Higher Education linked with Strategic Planning 
and Budgeting. Kansas: Strategic Planning/Management Associates, Inc, 1 997, 

The authors present on Introduction and historical overview of the concepts of outcomes 
assessment, strategic planning, and budgeting, viewed In on Integrated model. Includes excellent 
Ideas on external and Internal environment assessment, A glossary of more than 60 related 
concepts for beginners and on Impressive reference section ore presented, 

Grossman, G,M,, and M, E, Duncan, Indications of Institutional Effectiveness: A Process for Assessing Two- 
Year Colleges. Golumbus, Ghio: Genter on Education and Training for Employment, 1 989, 

Grossman and Duncan present on Interesting study on Indicators of Institutional effectiveness at 
community colleges. Their report odds to contemporary thought on the striking similarities between 
career colleges and community colleges, 

Merriam, Shoran B,, and Gofferella, Rosemary S, Learning In Adulthood: A Comprehensive Guide. 2""' 
edition. Son Francisco: Jossey-Boss, 1 999, 

A comprehensive work that examines the way adults learn and the context In which learning takes 
place, Merrlom and Gofferella draw from current research In sociology, philosophy, psycholog, 
and education to present o thorough examination of and new ways to think about adult learning, A 
"must read" for oil Involved In adult learning. 
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SUGGESTED REEERENCES: INSTITUTIONAL EEEECTIVENESS AND RELATED TOPICS 



Nichols, James O., and Nichols, KarenW, The Departmental Guide and Record Book for Student Outcomes 
Assessment and Institutional Effectiveness. New York: Agothon Press. 1995. 

Nichols, James O. A Practitioner's Handbook for Institutional Effectiveness and Student Outcomes 
Assessment Implementation. New York: Agothon Press. 1989,1991. 

Nichols, James O. Assessment Case Studies: Common Issues in Implementation with Various Campus 
Approaches to Resolution. New York: Agothon Press. 1995. 

Nichols, James O., and Nichols, Karen W. General Education Assessment for Improvement of Student 
Academic Achievement: Guidance for Academic Deportments and Committees. New York: Agothon 
Press. 2001. 

Nichols books are o "must read" for those engaged in developing plans for institutional 
effectiveness. They present the key elements in on Institutional Effectiveness Plan with emphasis in 
outcomes assessment implementation. The models presented give the administrator and 
institutional effectiveness leader practical ideas to address the institutional effectiveness issue. 

Nightingale, Peggy, and O'Neill, Mike. Achieving Qualit/ Learning in Higher Education. London: Kogan 
Page Limited, 1994. 

This book presents several duality issues and practices in higher education, with emphasis in quality 
teaching and learning, and case studies by leading international practitioners are included. 

Palomba, A. Catherine, and Banta, Trudy W. Assessment Essentials: Planning, Implementing and Improving 
Assessment in Higher Education. San Francisco: Jossey-Bass, 1 999. 

This book offers o step-by-step guide to the development of assessment programs in colleges and 
universities. A review of the most successful practices in this field. It presents ideas to assess college 
environment and students' experiences. A chapter on reporting and using assessment results is also 
included. 

Senge, Peter M. The Eifth Discipline: The Art and Practice of the Learning Organization. New York: Currency 
Doubleday, 1990. 

A "must read" for all who ore engaged in the business of providing and facilitating learning. 

Sperling, J. and Tucker, R. W. Por-Profit Education: Developing a World-Class Workforce. New Jersey: 
Transaction Publishers, 1997. 

Sperling and Tucker present an excellent picture of higher education from the perspective of the 
career college, for-profit sector. They present compelling evidence, further adding to the strengths 
of the for-profit education model. 

The Joint Committee on Standards for Educational Evaluation. Standards for the Evaluation of Educational 
Programs, Projects, and Materials. New York: McGraw-Hill (1 981 , 1 994). 

In 1994, the committee built upon prior research (1981) and established several standards for 
program evaluation that would be useful to those charged with evaluating an assessment program 
or evaluating instructional programs. Educational Programs, Projects, and materials. New York: 
McGraw-Hill (1994, 1994). 
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SUGGESTED WEB SITE ADDRESSES: INSTITUTIONAL EEEECTIVENESS AND RELATED TOPICS 



Suggested Web site addresses: 

Noel-Levitz: Provide research services and information about student iearning, retention, and other 
areas. 

Www.noeiievitz.com 



List of government resources that may be usefui in environmentoi scanning. 

Www.firstaov.aov 

Nationai Center for Education Statistics Where aii the iPEDS data goes! Loads of data about anything 
you want to know about education, inciudes a benchmarking site. 

Www.nces.ed.aov 

The Nationai Center for Pubiic Poiicy and Higher Education provides interesting and informative reports 
on the nationai status of higher education. Check out "Measuring Up 2000." 
Http://www.hiahereducation.org/ 

Maicoim Baidrige Nationai Quaiity Award Criteria offers a compietive award based on the ieve! of 
institutiona! guaiity. Very rigorous. 

Http://www.auaiityexperts.com/maicom-baidrige.htm 

The Nationai initiative for Leadership and institutiona! Effectiveness is housed at North Caroiina State 
University and was founded by Dr. George Baker, !!!, a pioneer in institutiona! effectiveness. 

Http://www2. ncsu.edu/ncsu/cep/acce/niiie/ 

Dr. James Nichois coordinates the institutiona! Effectiveness Associates. He is a ieader in institutiona! 
effectiveness and offers worthwhiie seminars. 

Http://www.iea-nich.com/ 

Sam Houston State University has pubiished anaiysis of their SWOT. 
Www.shsu.edu/~SACS/spcreport/environmentai-scan.htm 

Tuiane University has a comprehensive strategic pian, and it is on their Web site. 
Www.tuiane.edu/~sphtm/stratpian2000.htm 

Coiumbus State Community Coiiege has an impressive coiiection of materia! it uses for institutiona! 
effectiveness. For good ideas, check out their Web site. 
www.cscc.edu (search "institutiona! effectiveness") 

Aiverno Coiiege is a ieader in assessment of iearning. 

Http://www.aiverno.edu/ 

Mesa Community Coiiege has a strategic pian that focuses on iearning. 

Http://www.mc. maricopa.edu/oraanizations/empiovee/orp/piannina/Strateaic_pian_2002-2005. pdf 

Rochester Community and Technica! Coiiege (Minnesota) was one of the few community coiieges to 

be awarded the Baidrige Quaiity Award. 

http://www.roch.edu/rctc/ 
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INSTITUTIONAL EFFECTIVENESS PLAN CHECKLIST 



INSTITUTIONAL EFFECTIVENESS PLAN (lEP) 
CHECKLIST 

(Are these items in your lEP?) 



Section 3-1-110 



1 , The lEP is developed, implemented, and congruent with the institutional mission. 

2, The lEP identifies ways to assess and continuously improve educational programs and 
processes, 

3, Short-term objectives ore included in the plan. 



Section 3-1-111 



_1 . The lEP describes the characteristics of the programs offered. 

_2. The lEP describes the student population. 

_3. The lEP states how continuous improvement will be mode to improve or enhance these 
outcomes: (These five outcomes must be in the lEP The institution may choose to odd 
outcomes.) 

student retention rotes 

student placement rotes 

level of graduate satisfaction 

level of employer satisfaction 

student learning outcomes 

_4, The lEP describes the types of data, including baseline data, used for assessment, 

_5. The lEP describes how the data were collected. 

_6. The lEP describes the rationale for using the data. 

I . The lEP provides a summary and analysis of the data collected. 

_8. The lEP describes how the data were used to improve educational processes. 

_9. The lEP describes how baseline and comparative data were used to demonstrate that studen 
learning has occurred. 

1 0. The lEP identifies placement and retention rote goals for the following year and identifies the 
rotes for the post 3 AIR years 

I I . The lEP identifies the specific activities that will be undertaken to meet the goals set for the nex 
year. 
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INSTITUTIONAL EFFECTIVENESS PLAN (lEP), cont’d 
CHECKLIST 

(Are these items in your lEP?) 



Section 3-1-112 



1 , The lEP documents that the specific activities identified in the picn are carried out and that 
periodic progress reports are compieted. 

2, Periodic reports of iEP progress ore compieted to ensure that the pion's activities hove been 
impiemented. 

3, The institution has identified individuois assigned with the responsibiiity for impiementing and 
monitoring the iEP 



Section 3-1-113 

1 . The institution evoiuotes the pion, its goois, and activities at ieost onnuoiiy. 

2. The onnuoi evoiuotion reguires the determination of initioi boseiine rotes and a measurement 

of resuits after pionned activities hove occurred. 

3. The institution has documentation of historicoi outcomes (for the prior three years is sufficient). 

4. The iEP shows evidence of how this historicoi data is used to achieve expected goois. 

5. The institution has adjusted its goois os a resuit of the evoiuotion of the iEP 
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